Papers with self-harm detector
Challenges and Remedies of Domain-Specific Classifiers as LLM Guardrails: Self-Harm as a Case Study (2025.naacl-industry)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have impressive capabilities in generating human-like text, but they pose significant risks in many domains and require guardrails throughout the lifecycle. |
| Approach: | They propose to use a self-harm detector to test the performance of LLM guardrails in real-world environments. |
| Outcome: | The proposed model performs poorly in open and closed domains and is almost unusable in the real world. |